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Abstract. We study Markov processes generated by iterated function sys- 
terns (IFS). The constituent maps of the IFS are monotonic transformations 
of the interval. We first obtain an upper bound on the number of SRB (Sinai- 
Ruelle-Bowen) measures for the IFS. Then, when all the constituent maps have 
O common fixed points at and 1, theorems are given to analyze properties of 

the ergodic invariant measures <5o and Si. In particular, sufficient conditions 
for <5q and/or S\ to be, or not to be, SRB measures are given. We apply some 
of our results to asset market games. 

o 

m 

C/3 1. Introduction 

In the 1970's, Sinai, Ruclle and Bowen studied the existence of an important class 
of invariant measures in the context of deterministic dynamical systems. These in- 
variant measures are nowadays known as SRB (Sinai-Ruelle-Bowen) measures [14] . 
SRB measures are distinguished among other ergodic invariant measures because 
of their physical importance. In fact, from ergodic theory point of view, they are 
the only useful ergodic measures. This is due to the fact that SRB measures are 
the only ergodic measures for which the Birkhoff Ergodic Theorem holds on a set 
of positive measure of the phase space. In this note, we study SRB measures in a 
stochastic setting — Markov processes generated by iterated function systems (IFS). 

An IFSrj is a discrete-time random dynamical system [TJ [TU] which consists of 
j. | a finite collection of transformations and a probability vector {r s ;p s }g_ 1 . At each 

time step, a transformation r s is selected with probability p s > and applied to the 
Q\ process. IFS has been a very active topic of research due to its wide applications in 

fractals and in learning models. The survey articles [5J H3] contain a considerable 

list of references and results in this area. 

The systems which we study in this note do not fall in the category of the IF^] 
considered in [5J H2] and references therein. Moreover, in general, our IFS do not 
satisfy the classical splitting condition of |7J. In fact, our aim in this note is to 
depart from the traditional goal of finding sufficient conditions for an IFS to admit 
a unique attracting invariant measure [7J[5j[13]. Instead, we study cases where an 
IFS may admit more than one invariant measure and aim to identify the physically 
relevant ones; i.e., invariant measures for which the Ergodic Theorem holds on a 
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1 ln some of the literature an IFS is called a random map or a random transformation. 

2 In most articles about IFS, the constituent maps are assumed to be contracting or at least 
contracting on average. Here we do not impose any assumption of this type. In fact the class of 
IFS which we study in Section |3] cannot satisfy such assumptions. 

^In particular, when all the maps have common fixed points at and 1. See Section^ 
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set of positive measure of the ambient phase space. We call such invariant measures 
SRB. 

Physical SRB measures for random maps have been studied by Buzzi [3] in the 
context of random Lasota-Yorke maps. However, Buzzi's definition of a basin of an 
SRB measure is different from ours. We will clarify this difference in Section [2j A 
general concept of an SRB measure for general random dynamical systems can be 
found in the survey article |TT] . In this note we study physical SRB measures for IFS 
whose constituent maps are strictly increasing transformations of the interval. We 
obtain an upper bound on the number of SRB measures for the IFS. Moreover, when 
all the constituent maps have common fixed points at and 1 , we provide sufficient 
conditions for So and/or Si to be, or not to be, SRB measures. To complement our 
theoretical results, we show at the end of this note that examples of IFS of this 
type can describe evolutionary models of financial markets [4]. 

In Section [2] we introduce our notation and main definitions. In particular, Sec- 
tion [2] includes the definition of an SRB measure for an IFS. In Section[3]we identify 
the structure of the basins of SRB measures and we obtain a sharp upper bound 
on the number of SRB measures. Section [4] contains sufficient conditions for Sq and 
Si, the delta measures concentrated at and 1 respectively, to be SRB. It also con- 
tains sufficient conditions for Sq and Si not to be SRB measures. Our main results 
in this section are Theorems |4.3| and Theorem |4.7| In Section [5] we study ergodic 
properties of Sq and Si without having any information about the probability vector 
of the IFS. In Section [6] we apply our results to asset market games. In particular, 
we find a generalization of the famous Kelly rule [9] which expresses the principle 
of "betting your beliefs" . The importance of our generalization lies in the fact that 
it does not require the full knowledge of the probability distribution of the random 
states of the system. Section [7] contains an auxiliary result which we use in the 



proof of Theorem 4.7 



2. Preliminaries 

2.1. Notation and assumptions. Let ([0, 1], 03) be the measure space where 93 
is the Borel cr-algebra on [0, 1]. Let A denote Lebesgue measure on ([0, 1], 03) and 
S r denote the delta measure concentrated at point r £ [0, 1]. Let S — {1, . . . ,L} 
be a finite set and r s , s £ S, be continuous transformations from the unit interval 
into itself. We assume: 

(A) t s are strictly increasing. 

Let p = (p s )s=i be a probability vector on S such that for all s £ S, p s > 0. 
The collection 

F= {Ti,T 2 ,...,T L ;pi,p 2 ,...,p L } 
is called an iterated function system (IFS) with probabilities. 

We denote the space of sequences u> — {si, s 2l ■ ■ ■ }, sz £ S, by ft. The topology 
on ft is defined as the product of the discrete topologies on S. Let ir p denote the 
Borel measure on il defined as the product measure p N . Moreover, we write 

s* := (s 1 ,s 2 ,...,s t ) 
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for the history up to time t, and for any ro S [0, 1] we write 

r t (s') := T St o r St _ 1 o • • • o r Sl (r ). 

Finally, by E(-) we denote the expectation with respect to p, by 2?(-|s') the con- 
ditional expectation given the history up to time t and by var(-) the variance with 
respect to p. 

2.2. Invariant measures. F is understood as a Markov process with a transition 
function 

L 

P{r,A) = Y,PsXA(r s (r)), 

s=l 

where A S 05 and \A is the characteristic function of the set A. The transition 
function P induces an operator P on measures on ([0, 1], 05) defined by 

Pfi(A) = ( P(r,A)dn(r) 
Jo 

(2.1) 

= ^PsV{t- 1 A). 

8=1 

Following the standard notion of an invariant measure for a Markov process, we 
call a probability measure fi on ([0,1], 05) F-invariant probability measure if and 
only if 

Pfj, = fx. 

Moreover, it is called ergodic if it cannot be written as a convex combination of 
other invariant probability measures. 

2.3. SRB measures. Let /i be an ergodic probability measure for the IFS. Suppose 
there exists a set of positive Lebesgue measure in [0, 1] such that 

1 T_1 

(2.2) — <^r t (s*) W ~~ ! ' Y A* with 7T p -probability one. 

t=o 

Then fi is calle d an SRB (Sinai-Ruelle-Bowen) measure. The set of points tq £ [0, 1] 
for which (2.2 1 is satisfied will be called the basing of /i and it will be denoted by 
B(fi). Obviously, if X(B(fj,)) = 1 then /i is the unique SRB measure of F. 



3. Number of SRB measures and their basins 

The basin of an SRB measure for the systems we are dealing with is described 
by the following two propositions. 

Proposition 3.1. Let /i be an SRB measure and -B(/i) be its basin. Let r ,fo € 
B(fJt), r > f . Then [f ,r ] C B(y). 



4 Our definition of a basin is different from Buzzi's definition 3\. In his definition he defines 
random basins for an SRB measure. In particular, according to Buzzi's definition, for 

the same SRB measure, basins corresponding to two different w's may differ on a set of positive 
lebsegue measure of [0, 1]. See [3] for more detials. 
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Proof. When weak convergence is considered on an interval, then fi n wc _f^ ly ^ jf anc j 



only if fJ. n (f) —> /•*(/) f° r an y C 1 functiorj^] Since every C 1 function is a difference 
of two continuous increasing functions, this means that fi n wc f^ ly ^ jf anc ] only if 
fj> n (f) — > fJ-(f) for any continuous increasing function. 



Let ro,ro € B(fi) and ro < r' < rrj. We will show that r' Q € B(fi). Let assume 
that / is continuous and increasing. Let us fix an s* for which 



1 T-i 1 T-1 

t=o t=o 
We have rt(s*) < rj(s') < r t (s t ) (since all t s are increasing) and 

T— 1 T—1 T—1 

i=0 t=0 {=0 

The averages on the left and on the right have common limit fJ.(f). Thus, 

T-1 , T-1 



t=0 t=0 

Since the event 

1 t-i 1 T-1 

{ T lim - £ Hnis')) = T lim - finis')) = 
t=o t=o 

occurs with 7r p -probability 1, the event 



t=0 

also occurs with 7r p -probability 1. □ 

Proposition 3.2. Let /x be an SRB measure and B(/j,) = (a,b) be its basin, where 
(a, 6) denotes an interval closed or open at any of the endpoints. Then, 

T s (a) > a , s = 1, . . . , L, and if a =/= then r s (a) = a for at least one s; 
r s (b) < b , s — 1, . . . , L, and if 6 ^ 1 then t s (6) = 5 for at least one s. 

Proof. We will prove only the second claim with b =/= 1. The first claim is proven 
analogously. 



^Here is a sketch of the proof of this claim: Assume 

Hn(f) -> M/) 

for any / £ C 1 ([0, 1]). Let g be a continuous function and let {fk}k>l De a sequence of C 1 
functions converging to g in C° norm. We have 

\pn(g) - < - Mn(/fc)l + \i*n(fk) - + - Kq)\ 

<2\\f k -g\\ c o + \n n (fk)-Kfk)\ ■ 
Now, for any e > 0, we can find kg such that 2||/fc — g\\(jo < e/2 and then we can find no such 
that for any n > n we have |(U n (/fe ) - ^(/fc )| < £ / 2 - 
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Assume that r So (b) > b, for some 1 < sq < L. Then, we can find tq G (a, b) 
such that T So (ro) > b. For arbitrary continuous function /, for w £ A C O with 
7T p (^4) = 1, we have 

t=0 

The set A So = {(si, S2, ■ • ■ ) : (sen sx, S2, • • ■ ) € A} is also of 7r p -probability 1. Let 
r' = T So (r ) and let (s*)' denote the initial subsequences of length t of oj € A So . 
Then, 

T— 1 T— 1 

~ E /(^(( st )')) = ^E /M s ')) - + ^/(^i((^ T - 1 )')) — ^ m(/). 

t=0 t=0 

This shows that r So (ro) € B u (fj,) and contradicts the assumptions. 

Now, we assume that T s (b) < b, s = 1, . . . , L. Then, we can find ro > b such that 
Ts(^o) G ( a ;^) f° r a U s - Let 

1 T_1 

A s = : lim - £ /(*■{(**)) - //(/), for r = r s (r )} , a = 1, ...,L . 

t=0 

We have ir p (A s ) = 1 for each s. Hence, tt p (A) = 1, where A = Ui< s <l(s, A s ) 
and (s,A s ) = {(s, si, S2, S3, . . . ) : (si, S2, S3, . . . ) € For arbitrary continuous 

function /, for u> G A, if uj\ = s we have 

t=0 

= ^ ( ^ E/W((s')')) + i/(r ) ~ i/(r / T-i((* T - 1 )'))J = /»(/)' 

where r = r s (ro) and (s*)' are the initial subsequences of length t of u> G ^4 S . This 
implies that ro G B(fi). Since ro > 6, this leads to a contradiction. □ 

We now state the main result of this section. Firstly, we recall that (■, •) denotes 
an interval which is closed or open at any of the endpoints. Secondly, we define a 
set BS whose elements are intervals of the form (•, •) with the following property: 

(a, b) G BS 

if and only if 

T s (a) > a , s = 1, . . . ,L and r s (a) = a for at least one s; 

and 

T s (b) < b , s = 1, . . . , L and r s (b) = b for at least one s. 

Theorem 3.3. The number of SRB measures of F is bounded above by the cardi- 
nality of the set BS. In particular, ifO and 1 are the only fixed points of some r Sg , 
s G S , then F admits at most one SRB measure. 

Proof. The fact that number of SRB measures of F is bounded above by the cardi- 
nality of the set BS is a direct consequence of Proposition [3]2] To elaborate on the 
second part of the theorem, assume without loss of generality that t So (r) > r for all 
r G (0, 1). Obviously, by Proposition 3.2 if all the other maps r s , s G S \ {s } has 
no fixed points in (0, 1), then F admits at most one SRB measure. So let us assume 
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that there exists an s* G S \ {sq} such that t s » has a finite or infinite number of 
fixed points in [0, 1]. In the case of finite number of fixed points, denote the fixed 
points of t s » in [0,1] by r* , i = 1, . . . , q, such that < r* < r| < • • • < r* < 1. 
Since r s (r*) > r* for all r* G (0, 1), the only possible basin for an SRB measure 
would be either (r*_ 1 , 1) or (r*, 1). In the case of infinite number of fixed points, 



let 



r 



= sup{r G (0, 1) : r s «(r) = r}. 



If r < 1, then r So (r) > r. By Proposition 3.2 (r, 1) is the only possible basin for an 



SRB measure. If f = 1, let J denote the closure of the set of fixed points of r s * and 
let Jo Q J be the minimal closed subset of J which contains the point 1. Jo is the 
only possible basin for an SRB measure. Moreover, it cannot be decomposed into 
basins of different SRB measures. Indeed, let J\ U J2 = Jq such that J\ — (a, b) 



with b < 1. Since r So (&) > 6, by Proposition 3.2 Ji cannot be a basin of an SRB 



measure. Thus, F admits at most one SRB measure. □ 



The following example shows that Proposition |3 . 2| can be used to identify inter- 
vals which are not in the basin of an SRB measure. In particular, it shows that the 



bound obtained on the number of SRB measures in Theorem 3.3 is really sharp. 
Example 3.4. Let 

, for < r < 1/3; 
|(r- l) 2 , for 1/3 < r < 1; ' 




3^2 



r 2 , for < r < 2/3; 



n(r) = 

and 

T2 ^ [l-3(r-l) 2 , for 2/3 < r < 1. 

The graphs of the above maps are shown in Figure [T] Using Proposition |3.2| 
we see that the points of the interval (1/3,2/3) do not belong to a basin of any 
SRB measure. Moreover, by Theorem |3.3| F admits at most two SRB measures. 
Indeed, one can easily check that 80 and Si are the only SRB measures with basins 
B(5 ) = [0,1/3] and B{8i) = [2/3,1] respectively. For any r G [0,1/3) for all oj's 
the averages A J2t=o ^n(s') converge weakly to So- For r = 1/3 the only to for 
which this does not happen is lu — {1,1,1,...} so again the averages converge 
weakly to <$o with 7r p -probability 1. Similarly, we can show that B(S±) = [2/3,1]. 
If r G (1/3,2/3), then with positive 7r p -probability the averages converge to <5o and 
with positive 7r p -probability the averages converge to Si. Thus, these points do not 
belong to a basin of any SRB measure and there are only two SRB measures. 

4. Properties of So and Si 
In addition to condition (A), we assume in this section that for all s G S: 

(B) r s (0) = and r s (l) = 1; 



Obviously by Condition (B) the delta measures i5o and Si are ergodic probability 
measures for the IFS. We will be mainly concerned with the following question: 
When does F have S and/or Si as SRB measures? We start our analysis by 
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FIGURE 1 . Maps t\ and r 2 in Example |3.4| 

proving a lemma which provides a sufficient condition for 8 X , the point measure 
concentrated at a; € [0, 1], to be an SRB measure. 

Lemma 4.1. Suppose that t s (x) = x for all s S {1, . . . ,L} and that there exists 
an initial point of a random orbit r , r ^ x, for which lim^oo r t (s') = x with 
probability ir p = 1. Then 6 X is an SRB measure for F and B LU (5 X ) D [x, 

Proof. Let / be a continuous function on [0,1]. Let ro ^ x and fix a history s* for 
which lim^oo r t (s*) = x. Then 

lim f^)) = /(*). 

r — >oo 

Consequently 

T-l 

lim - ]T /(r t ( S *)) = /(a). 

t=0 

Since the event 

{ lim rt(s') = a;} 

t — >oo 

appears with probability one, the event 

{ lim ^ =/(*)} 

4=0 

''The notation here is for the case when ro > x. 
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also appears with probability one. Thus, by Proposition |3.1| 8 X is an SRB measure 
for F and Bu(6 x ) 3 [ x , r o]- D 

The following lemma, which is easy to prove, is a key observation for our main 
results in this section. 

Lemma 4.2. Each constituent map of the IFS can be represented as follows: 

7>(r ) =r JS.(r) j 

with (3 s (r) satisfying: 

(1) /3 s (r) >0 m (0,1) ; 

(2) (In r)(3 s (r) increasing; 

(3) lim r ^ (hir)/3 s (r) = -oo; 

(4) linw(ln r)[3 s (r) = 0. 

In the rest of this section, the following notation will be used: 

def 

a t := /3 s (r t _i) with probability p s , t = 1,2,... 

Theorem 4.3. Let F — {r s ;p s } se 5 &e an IFS such that r s (r) = r^ 3 ^ r \ Assume 
that < b s < (3 s (r) < B s < oo for all r <E [0, 1]. 

(1) If E^natYs 1 - 1 ) <0 a.s., then lim^^ r t (s*) ^ a.s. 

(2) //limsup-^^ ^ X)i=i ^(hi a* I s*" 1 ) <0 a.s., then lim^oo r t (s*) = 1 a.s. 

(3) //liminfj^oo ^ Y^t=i ^(lnatjs 4-1 ) > a.s., then lirm^oo r t (s*) = a.s. 
Proof. Let us consider the sequence of random exponents 

a(t) = a t a t _i • • • a 2 a 1: 
where at — /3 s (ri_i) with probability p s , and observe that 

r t (s 4 ) = r"^. 

We have 

In a(t + 1) = In a f+ i + In a{t), 

and, with probability one, 

E(kia(t+ l)|s*) -ln(a(t)) = £(lna m |s*) < 0. 

Therefore, lna(i) is a supermartingale. Moreover, because < b s < (3 s (r t ) < B s < 
oo, |lna(i + 1) — lna(i)| = |lna i+ i| < oo. Hence lna(i) is a supermartingale 
with bounded increments. Thus, using Theorem 5.1 in Chapter VII of |12j . with 
probability one lna(i) does not converge to +oo. Consequently, with probability 
one, r t (s*) = r a ^ does not converge to zero. 

We now prove the second statement of the theorem. Again we consider the 
sequence of random exponents 

a(t) = a t a t _i • • • a 2 «i. 

Let M t denote the martingale difference 

M t := In at - E(ln a^s 1 " 1 ). 

We have E(M t ) = and In at is uniformly bounded. Therefore, by the strong law 
of large numbers (see Theorem 2.19 in [5]), with probability one 

1 T 

(4.1) lim -VM(=0. 

t=l 
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Therefore, with probability one, 

T 

1 1 . , 

lim sup — In a(T) = lim sup — In a t 



T „ T 



limsup — ^2 M t + limsup — ^ £7(lna: t |s* x ) < 0. 



T->oo T t=i ' T t=i 

From this we can conclude that for T large enough there is a positive random 
variable 77 such that 

a(T) < e~ Tr > a.s. 
Thus, since r £ [0,1], for T large enough we obtain 

r T+1 = r Q(T) > r e_T " a.s. 
By taking the limit of T to infinity we obtain 

lim tt+i = lim r a ' T ' > lim r e — 1 a.s. 

T-+00 T^oo T-^oo 

The proof of the third statement is very similar to the proof of the second one with 
slight changes. In particular, using (4.1 1, we see that, with probability one, 

liminf — lna(T) > 0. 

From this we can conclude that for T large enough there is a positive random 
variable 77 such that 

a(T) > e T " a.s. 
Thus, since r € [0, 1], for T large enough we obtain 

r T+ i = r a(T) < r eTv a.s. 
By taking the limit of T to infinity we obtain 

lim tt+i = lim r Q< - T - ) < lim r e V — a.s. 

T^oo T— >oo T-+00 



□ 



Corollary 4.4. Let F = {r s ;p s } s6 5 be an IFS such that r s (r) = r^"^ r '. Assume 
that < b s < j3 s (r) < B s < 00 for all r e [0, 1]. 

(1) If limsupj^^ 7^ J2t=i Efincttls*' 1 ) < a.s., then Si is the unique SRB 
measure of F with B{8{) = (0, 1] . 

(2) If liminfr^oo y St=i ^( ma tl s ' _ ) > a.s., then <5 is the unique SRB 
measure of F with B(5q) = [0, 1). 



Proof. The proof is a consequence of statements (2) and (3) of Theorem 4.3 and 



Lemma [47T] □ 

Remark 4.5. Observe that: 

(1) J2 s Ps^B s < ==> ^(lnatls'- 1 ) < a.s. 

(2) £ s p s lnB s < =► nmsup T ^i £f =1 £(ln c^s*- 1 ) < a.s. 

(3) J2 sPs lnb s >0 => liminfr^iE^i^Clnatls*- 1 ) >0 a.s. 

Thus, the conditions in the statements of Theorem |4.3| and Corollary |4.4| are very 
easy to check for certain systems. 
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Remark 4.6. In the proof of statement (1) of Theorem 4.3 we have with probability 
7T p = 1, lirm^oo In a(t) =^ oo. In general, it is not clear that this implies that 5q is 
not an SRB measure. However, in the following theorem under additional natural 
assumption on the variance of In at we show that Sq is indeed not an SRB measure. 

Theorem 4.7. If E^na^s*- 1 ) < and var(ln a^s*- 1 ) > d > 0, for allt > 1, then 
Sq is not an SRB measure of F. 

Proof. Consider the sequence of random exponents 

a(t) — a t a t -i ■ ■ ■ a 2 ai, 

where o,i = /3 s (r t _i) with probability p Sl and observe that 

r t (s*)=r a W. 

Observe that 

T 

lna(T) = J2 lna t- 
{=1 

Since 

E(]na(t)|s* -X ) -lna(t-l) = sanc^s^ 1 ) < 0, 

and 

< b s < (3 s (r t ) < B s < oo. 

the sequence Zt = In a(T) forms a supermartingalc with bounded increments. 
Doob's decomposition theorem gives the representation 

Zt = \Yrp -\- St-, 

where Wt — J2t=i E(ln a^s 1 ' 1 ) is a decreasing predictable sequence and 

T 

S T = ^[lna f -£(lna t | S t - 1 )], 
t=i 

is a mean martingale with bounded increments. By Theorem 5.1 (Ch. VII) of [T5] 

with probability 1 process St either converges to finite limit or lim sup^ >00 St — 

— lim inf'j'—^x, St = oo. In the first case the process Zt is bounded from above. 
We will consider only the second case to show that with positive probability the 
process Zt is bounded from above for a set of indices T which has positive density 
in N, i.e, there exist M > 0, < a, b < I such that 

(4.2) 7T p (lim S up *{t<T:Z t <M} > q) > fo 

Let us denote 

X t = lna t - ^(lnatls*- 1 ) , t > 1. 

This sequence satisfies assumptions of Theorem 7.1 with At = c(s*)- We have 
EiXfla*- 1 ) = E(Qna t - EQnatls*- 1 ))^*- 1 ) 

= ^p s (ln&(r)) 2 - (£ Ps ln/3 s (r)) = var(lnat|» t-1 ) > d > 0. 

s=l Vs=l / 
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Thus, the sequence X t satisfies assumptions of Proposition 7.2 In particular, (7.1) 
holds, i.e., if Post is the number of times haa(t) > for t <T, then 

Posy 

hmsup[7T p (— — — < a)\ — b > 0, 

where a, b are some numbers in (0, 1). This means that if Nt is the number of times 
lna(f) < for t < T, then 

limsup[7r p (-— > 1 — a)] = b > 0. 

Now, we we show that 

N T 

7Tp(limsup — f > 1 - a) > b/2 > 0. 

For T > T we have tt p (^ > 1 - a) > b/2. Let A T = > 1 - a}, T > T . The 
set which contains points from infinitely many At is A = flj Utm and since the 
sequence (Utm^t^ is decreasing we have 

tt p (A) = lim 7r p (U T >i4r) > 6/2 . 

i — >oo 

Thus, with a positive probability b/2 > 0, there exist a sequence T„ — > oo such that 
-jt^ > 1 — a or 

7r p (limsup — f > 1 - a) > 6/2 > 0. 

Thus, lna(T) is negative with positive density, i.e., 

lim < T : lna(t) < 0} > 1 - a > 0, 

with positive probability b/2. This implies that tt{st) > r > with positive 
density 1 — a and positive probability b/2. We can construct a continuous function 
/ which is around and 1 above r. The averages of this function satisfy 

limsup^ f( r T'(s T ')) >l-0, 

with nonzero probability 6/2 which proves there is no weak convergence to So- □ 

Remark 4.8. If -E(lna t |s* -1 ) > and var(lna t |s t_1 ) > d > 0, for all t > 1, using 
essentially the proof of Theorem 4.7 we obtain that 5i is not an SRB measure of 
F. In particular, if i5(lna t |s* _1 ) = and var(lna t |s t_1 ) > d > 0, for all t > 1, we 
obtain that neither <5 nor ^ is an SRB measure. 

5. Properties of S and Si: The case when p is unknown 

In general, one cannot decide whether 5o or Si is the unique SRB measure without 
having information about p. We illustrate this fact in the following example. 

Example 5.1. Let F = {t±, t 2 ; Pi,P2} where n = r 2 , t 2 = \/r and pi,p 2 are un- 
known. Observe that the exponents, which are explicit in this case and independent 
of r, are /3i(r) = 2 and (3 2 (r) = 1/2. Then 

Pl \nB 1 {r)+p 2 \nB 2 {r) = (2 Pl - l)ln2. 



By Corollary 4.4 if pi < 1/2 the measure Si is the unique SRB measure of F; 
however, if pi > 1/2 the measure S is the unique SRB measure of F. Thus, for 
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this example, without having information about p, no information about the nature 
of S or Si can be obtained. 



Although Example 5.1 shows that the analysis cannot be definitive in some cases 
without knowing the probability distribution on S, our aim in this section is to find 
situations when Sq and/or Si are not SRB. Moreover, in addition to studying the 
properties of Sq and Si, we are going to study the case when the IFS admit an 
invariant probability measure whose support is separated from zero and is not 
necessarily concentrated at one. The definition of such a measure is given below. 

Definition 5.2. Let /i be a probability measure on ([0, 1], 25), where 23 is the Borel 
cr-algebra. We define the support of fi, denoted by supp(/x), as the smallest closed 
set of full /j, measure. We say that supp(/x) is separated from zero if there exists an 
n > such that At([0,7y]) = 0. 

In addition to properties (A) and (B), we assume in this section that: 



(C) Every r s has a finite number of fixed points. 



In this section, we use a graph theoretic techniques to analyze ergodic properties 
of Sq and S\. This approach is inspired by the concept of a Markov partition used 
in the dynamical systems literature. For instance, in [2], the ergodic properties of 
a deterministic system which admits a Markov partition is studied via a directed 
graph and an incidence matrix. In our approach we construct a partition for our 
random dynamical system akin to that of a Markov partition and use two directed 
graphs to study ergodic properties of the system. 

We now introduce the two graphs, Gd and G u , which we will use in our analysis. 

(1) Both Gd and G u have the same vertices; 

(2) For s G {1, . . . , L}, an interval J s , m — (p-s,m,a>s,m+i) is a vertex in Gd and 
G u if and only if T s (a s , m ) = a s , m , T s {a s<m +i) = a Sim+ i and r s (r) ^ r for 
all r € (a S}7n , a s , m+ i); 

(3) Let J s m and Jij be two vertices of Gd- There is a directed edge connecting 
J s ,m to Jij if and only if 3 an r G J s .m, r > ai,j+i, and a t > 1 such that 
rt{r) E Jij- 

(4) Let J s>m and J;j be two vertices of G u . There is a directed edge connecting 
Js,m to J/j if and only if 3 an r € J s ,m, f < and a t > 1 such that 
r s '(r) g J u . 

(5) By the out- degree of a vertex we mean the number of outgoing directed 
edges from this vertex in the graph, and by the in- degree of a vertex we 
mean the number of incoming directed edges incident to this vertex in the 
graph. 

(6) A vertex is called a source if it is a vertex with in-degree equals to zero. A 
vertex is called a sink if it is a vertex with out-degree equals to zero. 

For the above graphs, one can identify two types of vertices: let (a s , m , fls,m+i) be 
a vertex. If r s (r) > r for all r £ (a s , m , a Si7n +i), then the vertex (a s , m , a s ,m+i) 
will be denoted by J s>m . If t s (t) < r for all r £ (a s . m , a SiJ7l +i), then the vertex 
(a s . m , a Sjm +i) will be denoted by J s , m - When we prove a statement for a vertex 
J s , m (without a label), this means that the result holds for both types of vertices. 
The following lemma contains some properties of Gd and G u . 
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Lemma 5.3. Let Gd and G u be defined as above. 

(1) If J s , m is a vertex in Gd, then J s>m is a sink in Gd- 

(2) Let J s , m and J\ j be two vertices in Gd- There is a directed edge connecting 
J s . m to Ji j in Gd if and only if a s>m < ai.j + \ < a Stm +l- In particular for 
all s G S there is no directed edge in Gd connecting J s>m to J s j for any m 
and j . 

(3) If J s , m is a vertex in G u , then J s>m is a sink in G u . 

(4) Let J s . m and Jij be two vertices in G u . There is a directed edge connecting 
Js.m to Ji.j in G u if and only if a s ^ m < o>i j < a s . m +i- In particular for all 
s G S there is no directed edge in G u connecting J Sl m to J s j for any m and 
j- 

Proof. The proof of the first statement is straight forward. Indeed, let J;j be any 
vertex in Gd and r G J s .m such that r > aij+i- Then for all t > 1 r*(r) > 
r* _1 (r) > . . .T s (r) > r > a/j+i. The proof of the second statement follows from 
the fact that if r > a s , m > a i.j+i then for t > 1 we have r*(r) > a s . m > a>i,j+i- If 
r > ai.j + \ > a s . m , then there exits a t > 1 such that a s . m < T~l(r) < ai j+i. Proofs 
of the third and fourth statements arc similar to the first two. □ 

For our further analysis we introduce the following notion. 

Definition 5.4. We say that a random orbit of F stays above a point c if all the 
points of the infinite orbit are bigger than or equal to c with probability tt p = 1. 

Lemma 5.5. Let Ji.j be a vertex in Gd such that dij+i ^ 1. If Ji j is a source 
in Gd, then the random orbit of F starting from r > aij+i stays above ai,j+i with 
probability 7r p = 1. 

Proof. Suppose Ji.j is a source in Gd- Then for all r > aij+i, we have r|(r) > <xj,j+i 
for all s € S and t > 1. This means that if r > aij+i we have T Sl (r) > a/j+i and 
r S2 o T Sl (r) > a/j+i and so on. □ 

Theorem 5.6. Let F be an IFS whose transformations satisfy the properties (A), 
(B) and (C). 

(1) If for all s G S there is a vertex J s , m in Gd with a s m = 0, then Sq is an 
SRB measure, B(Sq) D [0, a), where a = min s {a s m+ i}. In particular, for 
any r G [0, a), lim t r t (s*) = a.s. 

(2) If for all s G S there is a vertex J s . m in Gd with a s . m +i = 1 ; then 6% is 
an SRB measure. Moreover, B(5i) 2 (frjl]; where b — max s {a Sjm }. In 
particular, for any ro G (6, 1], lim t r t (s') = 1 a.s. 

(3) Let Jij be a vertex in Gd such that Ctyj+i 7^ 1. If Jij is a source in G^ 
then F preserves a probability measure whose support is separated from 

E 

(4) Let Jij be a vertex in G u such that aij+i 7^ 0. If Jij is a source in G u 
then F preserves a probability measure whose support is separated from 1. 



^In the case where a; j = 0, even if other j s , m , with a 3 . m = 0, receives a directed edge, the 
result still holds. Thus, to know the existence of an invariant probability measure whose support 
is separated from 0, it is enough to check that one vertex J; , with a; , = which is a source in 



Gd- Statements of Lemma 5.3 can be useful to visualize cases of this type. 
®The invariant measure here is not necessarily S\. 
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(5) Let J s *,m be a vertex with a s *,m — whose out-degree in G u is at least one. 
If 3 a vertex J So j in Gd, CL So ,j — an d a s j+i < a s* m+ii which is a source 
in Gd, then for any tq £ (0, 1], lim t r t (s') ^ a.s. Moreover, 5q is not an 
SRB measure for F. 

(6) Let J So ,j be a vertex in Gd such that a So j+i = 1 and whose out-degree in 
Gd is at least one. If 3 a J s * lTn in G u , a s ». m +i = 1 and a s * >m > a So j, which 
is a source in G u , then for any r £ [0,1), lim t r t (s*) =/= 1 a.s. Moreover, 
Si is not an SRB measure for F. 

(7) If for all s £ S the vertices whose a Sjm = are of the form J s , m and their 
a s _ m+ i = a are identical, then for any ro in (0,a], with probability one, 
lim t r 4 (s*) = a. In particular, 5 a is an SRB measure with B(5 a ) = (0,a] 
and Sq is not an SRB measure. 

(8) If for all s € S the vertices whose a s .,„+i = 1 are of the form J s . m and 
their a s>m = b are identical, then for any tq in \b, 1), with probability one, 
limt rt(s*) = b. In particular, 5b is an SRB measure with B(Sb) = [b, 1) and 
Si is not an SRB measure. 

Proof. We only prove the odd numbered statements in the theorem. Proofs of the 
even numbered statements are very similar. 

(1) For any ro G [0, a), any random orbit of F will converge to zero. Using Lemma 
|4.1| this shows that Sq is an SRB measure with B(Sq) 2 [0,a). 
(3) Let ro > a/j+i. Since [0,1] is a compact metric space and for all s £ S t s 
is continuous, the average A Y^t=o P t ^r °f the probability measures converges in 
the weak* topology to an F invariant probability measur^j By Lemma 
measure is supported on [a/j+i, 1]. 
(5) Let D = {J Stm \ {0} : a s ^ m = 0}. For any r £ D, there exists a fi nite 
t > 1 such that r*»(ro) > a So> j+i. Since J So j is a source in Gd, by Lemma 5.5 



5.5 



this 



r*«(ro) stays above a So J+1 with probability 7r p = 1. Therefore, for any r € D, 
with positive probability, the random orbit of ro is bounded away from 0. Let us 
consider now the case of a starting point r' > a„ 0i „ l+ i . Since all the transformations 
are homeomorphisms and is a common fixed point, for any r' > a S0;m +i and any 
t > 0, with positive probability r t (s*) > a S0)m _|_i. Hence, for any r £ (0,1], 
with strictly positive probability, lim^oo r t (s t ) > a So , m +i- Moreover, with strictly 
positive probability, for any r £ (0, 1], there exists a T — 1 > to > 1 such that 

1 r f\ 1 / t\ (^0 + 1) 

t=0 t=0 

Therefore, with strictly positive probability, for any r £ (0,1], 

1 

(5-1) lim - V r t (s*) > a So , m+ i. 

J — >oo 1 ' ' 

t=0 

Now, to show that S is not an SRB measure, it is enough to find a continuous 
function / on [0, 1] such that with positive probability, for any r £ (0, 1], 



1 — >oo 1 * — ' 

t=0 

^This follows from a random version of the Krylov-Bogoliubov Theorem pQ. 
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Indeed, this is the case if we use the function f(r) = r and (5.1 1. Thus, So is not 
an SRB measure.. 

(7) Obviously, for any tq S (0, a], the random orbit of F starting at rp will converge 



to a. Using Lemma 4.1 this implies that 5 a is an SRB measure with B(5 a ) = (0, a]. 
Moreover, since all the transformations are homeomorphisms with common fixed 
point at a, for any r Q > a, the random orbit of F stays above a. Thus, Sq is not an 
SRB measure. □ 

6. Asset Market Games 

In this section, we apply our results to evolutionary models of financial markets. 
In particular, we will focus on the model introduced by [J. First, we recall the 
model of [I]. 

6.1. The Model. Let S is a finite set and St G S, t = 1,2,..., be the "state of the 
world" at date t. Let p be a probability distribution on S such that for all s € S 
p(s) > 0. We also assume that St are independent and identically distributed. 

In this model there are K "short-lived" assets k = 1,2, ...,K (live one period 
and are identically reborn every next period) . One unit of asset k issued at time t 
yields payoff -D/c(st+i) > at time t + 1. It is assumed that 

^2 _ D k(s) > for all se S 

and 

ED k (s t ) > 

for each k = 1,2, K , where E is the expectation with respect to the underlying 
probability p. The total amount of asset k available in the market is V k = 1. 

In this model there are / investors (traders) i = 1, I. Every investor i at each 
time t = 0,1, 2, ... has a portfolio 

x t = ( x t,li ■••) X t,K)l 

where x\ k is the number of units of asset k in the portfolio x\ — xKs*), s* = 
(si,...,s t ). We assume that for each moment of time t > 1 and each random 
situation s', the market for every asset k clears: 

(6.1) ^< fc ( S 4 ) = l. 

i=l 

Each investor is endowed with initial wealth w > 0. Wealth w\ +1 of investor i at 
time t + 1 can be computed as follows: 

K 

(6-2) <i = E B *M^' 

fc=i 

Total market wealth at time t + 1 is equal to 

/ K 

(6-3) w t+ i = w t+i = D k(s t +i)- 

i = l k = l 

Investment strategies are characterized in terms of investment proportions: 

A* = i^O) ^li ^2' ■■■} 
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of if-dimensional vector functions \\ — (A| 1( X\ K ), X\ k — X l t fc (s*) t > 0, satis- 
fying X\ k > 0, Ylk=x K k — 1- Here, X\ k stands for the share of the budget w\ of 
investor i that is invested into asset k at time t. In general X l t k may depend on 

s 1 = (ax, S2, St). Given strategies A 1 = {A , Ax, A|, ••■} of investors i — 1, ...,/, 
the equation 

(6-4) Rfc -l=^Al ;fc ^ 

t=i 

determines the market clearing price p t .k — Pt.fe(s') of asset The number of units 
of asset k in the portfolio of investor i at time t is equal to 

(6.5) ^ 
Therefore 

(6-6) . *'V - ■ 



By using (6.6 1 and (6.2 1, we get 

K 

(6-7) <i = ^£> fe ( Si+ x)- 7 



fe=i Lj^i^lfc 1 "* 

Since w > 0, we obtain w\ > for each i. The main focus of the model is on the 
analysis of the dynamics of the market shares of the investors 



i = 1,2,...,/ 



Using (6.7 1 and (6.3 1, we obtain 



K AS 



(6-8) r| + x = ^fl fc ( 5f+ x) ^ 7 -j , i=l,2, 

where 



/,— j Sj=i A/'.;. ''/ 



R / \ Dk(s t +i) 
rik(St+l) — 



E m =l ^m(st+l) 

are the relative (normalized) payoffs of the assets k = 1, 2, ZT. We have Rk(s) > 
and X)k-Rfc( s ) = L 

6.2. Performance of investment strategies and the Kelly rule. In the theory 
of evolutionary finance there are three possible grades for investor i (or for the 
strategy she/he employs): 

(i) extinction: limrj = Oa.s.; 

(ii) survival: limsuprj > but liminfrj < 1 a.s.; 

(iii) domination: limrj = 1 a.s. 

Definition 6.1. An investment strategy is called completely mixed strategy if it 
assigns a positive percentage of wealth At fc(s') to every asset k — 1, . . . , K for all 
t and s*; moreover, it is called simple if Xt,k( st ) = X k > 0. 
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In this theory, the following simple portfolio rule has been very successful: define 

X* = (X* V ...,X* K ), X* k = ER k (s t ) 1 k = l,...,K, 

so that Xi, X* K are the expected relative payoffs of assets k = 1, K. The port- 
folio rule A* is called the Kelly rule which expresses the investment principle of 
"betting your beliefs" j9]. In [4] under the following two conditions: 

El) There are no redundant assets, i.e. the functions i?i(s), ...,Rx(s) of s € S are 
linearly independent. 



E2) All investors use simple strategies; 



it was shown that investors who follow the Kelly rule survive and others who use a 
different simple strategy get extinct. In particular, If only one investor follows the 
Kelly rule, then this investor dominates the market. 



The main challenge in using the Kelly rule lies in the fact that it requires from 
investors the full knowledge of the probability distribution p. In Subsection |6.4| 
using an IFS representation of (6.8 1 and Theorem 4.3 we overcome this difficulty 



by finding another successful strategy which requires partial knowledge of the prob- 
ability distribution p. 



6.3. An IFS realization of the model. In the rest of the paper, we are going to 
show how the above model can be represented by an IFS. We are going to apply the 
results of Sections [4] and [5] to study the dynamics of (6.8 1. As in 0], we assume here 



that all the investors use simple strategies. Further, we focus on the casq | when 



1 = 2. The market selection process (6.8 1 reduces to the following one dimensional 
system: 

(6.9) ^^ +1 )-g^) ^ + Afe-, t ) ' 

where r t is investor's 1 relative market share at time t and {X\) k=1 and (A^)^Lj^ 
are the investment strategies of investor 1 and 2 respectively. Then the random 



dynamical (6.9 1 of the market selection process can be described by an iterated 



function system with probabilities: 

F = {n,T 2 , ■ ■ .,T L ;p 1 ,p 2 , . . . ,p L }, 

where 

We first note that the transformations r s of the IFS of the market selection process 
are maps from the unit interval into itself and they satisfy assumptions (A), (B) 
and (C). In fact, the maps for this model have additional properties. For example, 
they are diffcrentiable functions. 



This is the same as assuming that there are I investors, I > 2, where I — I investors use the 
same strategy and only one investor deviates from them. 
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6.4. Investors with partial information on p and a generalization of the 
Kelly rule. We use Theorem |4.3| to provide a rule for investors with partial in- 
formation on p. The investor who follows this rule cannot be driven out of the 
market; i.e., she/he either dominates or at least survives. The importance of this 
rule lies in the fact that investor 1 does not need to know the Kelly rule exactljj^] 
She/he only needs to know a perturbation of the Kelly rule; for example, the Kelly 
rule plus some error bounds. 

Firstly, we show in the following lemma that the logarithms of the exponents 
Ps{r) are uniformly bounded. 



Lemma 6.2. Let 



Mr 



^)=X> A i r+ ~| (1 _ r) , re [0,1], 
and 

r ( r ) = r ftr) t 

where, for each 1 < k < K we have Rk > 0, \\ > 0, A 2 , > and 53feLi Rk ~ 
SfcLi = SfcLi ^fe = 1' Then for any r € U, U C [0, 1], ln(/3(r)) is bounded. 

Proof. Without loss of generality, we assume that U — [0,1]. We have r(r) = 
r P(r) — exp(ln(r)/3(r)), so 

The minimum and maximum of (3(r) can be attained at r = 0, r = 1 or at a point 
of a local extremum. Using De L'Hospital rule we find 



K A 2 

lim (3(r) = 1 and lim f3(r) = Vl? fc -f 

- +0+ r— >1~ — 4 A 



k=l 



k 



A point of local extremum r* in (0, 1) of (3{r) is found by solving 

^ ^ ^ ln(r) \ r(r) 
Therefore, at the point r = r* of local extremum 

., (r ) *=1 " fe [Air.+AjJd-r.)] 2 



Observe that the function 



fe=l [Air+A^(l-r)] 2 

V K R, ^ 

l^k=l A£r+A£(l-r) 

is continuous at [0, 1]. Thus, it attains its maximum and minimum on [0, 1]. This 
completes the proof of the lemma. □ 



It is often difficult for an investor to know the exact probability distribution of the states of 
the world. 
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Corollary 6.3. Let 



K 



^) = E^) A i r + A | (1 _ r) > re [0,1]. 



fc=l 



Then for r € U, U C [0, 1], 



Z^fc=l -"fe Afr+A?(l-r) 2^*=1 



r+A|(l-r) ^tl" s Air+A 2 t (l-r) 

Theorem 6.4. If for each k E {l,...,K} X\ lies between ER k and X\, then 
investor 1 cannot be driven out of the market; i.e., she/he either dominates or at 
least survives. 

Proof. Let us consider the function 

G W = E»*a^o ' rG[0 ' 1] ' 

k=l ky 1 

where 

A fc (r) - \\r + X 2 k (l - r) = (\\ - \ 2 k )r + X 2 k , 

and V — (v±, t>2, ■ ■ • , Wl) is a probability vector. We will find conditions on X\ which 
ensure G(r) > 1, r € [0, 1]. It is easy to see that 

(6.10) G(1) = 5>*^ = 1- 



fe=i 



A' 



We also have 



and 



G >) = E^ 2( ( A fc (r) A )3 2 > ° ' rG[0 ' 1] - 



k=l 

Thus, G is a convex function and its derivative G' is increasing. If G'(l) < then 
G is decreasing and because of (6.101 this implies that G(r) > 1, r G [0,1]. Observe 
that 



G'(l) = E ^ { %/ k) = E £(A2 - Ai). 



k=l y ki k=1 fc 

It is easy to see that a sufficient condition for G'(l) < is 

v k >Xl if X\>Xl; 

(6.11) 

« fe <A£ if A^<A 2 fe , 

or, in short, for each k, \ <k < K, X\ should be between X k and v k . 
Now, let us consider the expression 

L 

E^M^W). 

s=l 
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We have 
(6.12) 



^p s ln(/3 s (r)) <ln 




< In 



= >-( 1,1 1 > j> ]i>*ih-i«" ii ) = 1,1 ( 1 + ^ in ( c w) 

with Vk being the expected payoff for the fc th asset, Vk = X)s=i-Ps-Rfc(s), k 
l,...,K. 

A sufficient condition for X^=i Ps ^ n (Ps(r)) < is for r G [0, 1]: 



ln(G(r)) > or equivalently G(r) > 1. 



We have shown before that a sufficient condition for this is (6.111 or placing each 
between the expected payoff Vk and A 2 ,. 



To complete the proof of the theorem, we first use Lemma 6.2 to observe that 
exponents (3 s (r) of this system are bounded and then (1) of Theorem 4.3 Indeed, 
for any fixed partial history s* -2 , because the stochastic process s t is an iid process, 
we have 

L 



/ j i 

3=1 



a 



6.5. Incorrect beliefs. Our results in Section [5] are also interesting for studying 
the dynamics of (6.8). In fact, they can be used to study the dynamics in the 
situation where both players have 'incorrect beliefs'; i.e., when players do not have 
the right information or partial information about p. Thus, they either use wrong 
distributions to build their strategies or they arbitrarily choose their strategies. 
Consequently, their strategies are, in general, different from the Kelly rule and 
the generalization which we presented in Subsection |6.4| In this case, the results 
of Section [5] can be used to identify the exact outcome of the game in certain 
situations. In some situations, as in Example 5.1 one cannot know the outcome of 
the system without knowing p. 

7. Appendix 

The following general arcsine law has been proved in [6 . 

Theorem 7.1. [B] Let Xi, X 2 , ... be a sequence of random variables adapted to the 

sequence of a -algebras Ai,A 2 , Let S m = J2iLi X i> v m = YhLi E i X i\-Ai-i) 

and assume 

E(X m+ i\A m ) — , EX m < oo , and v m — > oo a.s. 
Let T n = inf{m : v m > n} and L n = i Yn=i ^(^ 2 |^i-i)X{s,>o} ■ If 



~ X iX{X?>n£} f° T al1 £ > °' 

i=l 
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then the distributions of L n converge to the arcsine distribution. 



We now use Theorem |7.1| to prove a proposition which is used in the proof of 
Theorem 14.71 



Proposition 7.2. Let X ll X 2 , ... be a sequence of random variables adapted to 

the sequence of er-algebras A\ , A%, Suppose that there exist constants d > 

and < D < oo such that for all n > 1 we have 

< d < E{X 2 n \A n -i) and X 2 n < D. 

Then, the sequence satisfies the remaining assumptions of Theorem 1 7. 1| In partic- 
ular, Theorem |7. 1| implies the condition 



Pos 

(7.1) limsup Pr{ < a) > b > 0, 

n — >oo n 

for some constants < a, b < 1, where Pos„ = X)"=i X{Si>o}- 

Proof. The remaining assumptions of Theorem |7. 1 1 are trivially satisfied. We have 
m ■ d < v m < m ■ D for all m > 1 so T n ■ d < n < T n ■ D for all n > 1. Then, 

T 

1 1 ^2, 

n - ~f>Y ^ X{S * >0} 

n i—1 

and, for < a\ < 1, we have 

/d 1 ^ \ ,2 _ 

Pr y.Tfr Z_^X{Si>o} < ai > Pr{L n < ai) — > -arcsm^/ai. 

For ai small enough we obtain a meaningful estimate 

Pr (^rYlx{Si>o} <aj> ^arcsinVa, 



for a — cki^r and n large enough. This implies condition (7.1 1. □ 
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